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Figure 5(a) 
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Figure 5(b) 
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DATA RETRIEVAL SYSTEM 

The invention relates to a data retrieval system, in particular a 
system for retrieving hierarchically related objects from a relational 
database. 

This invention is described in relation to an ldap (Lightweight 
Directory Access Protocol) directory server using a relational database 
as a backing store. This is a particularly appropriate example of 
hierarchical information which is nonetheless stored in a relational 
database. It will be seen from the following description, however, that 
the invention is not restricted to LDAP and is of use wherever 
hierarchically related objects (data) have to be stored and retrieved 
from a relational database. 

An LDAP directory of the known type comprises a collection of 
hierarchically related objects, an example of which is shown in Figure 1. 
The structure of the directory and content of its objects are typically 
determined by the contents of a schema object which is normally itself 
stored in the directory. The contents of this schema object comprise a 
set of object class definitions and a set of structural rules, as shown 
for the above example in Figure 2. The class definitions include a) a 
list of both mandatory (M) and optional (0) attributes for each object 
class allowed in the directory; and b) a list defining the hierarchical 
relationships between object classes and hence the inheritance rules for 
class definitions, in the above example, all object classes other than 
top are subclasses of the class top, thus inheriting the attribute 
objectClass. 

The structural rules control the arrangement of objects in the 
directory hierarchy and comprise a list of the allowed child object 
classes to each parent class and, for each such combination, the naming 
attribute (s) to be used to provide a unique relative distinguished name 
(rdn) for such an object. 

The relative distinguished name (RDN) provides a unique name for an 
object at Uxat point in the directory hierarchy, its format is thus 
somewhat unpredictable for any object, as it is formed by a combination 
of one or more of the object's attributes and as can be seen from the 
naming attributes for employees, many different attributes may be used 
for an object at any one point in the tree. LDAP objects also have a 
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unique name in the directory - the distinguished name <DN) . The DN is 
formed by the successive, sequential concatenation of the RDNs of the 
object itself and its parents, back up to the root of the directory tree. 

Thus, even in the simple case of Figure 1, the RDN for John Doe may 
be init=JDD+ID=005047, and the DN may be orgNaxne=IBM, siteName=Arizona r 
init=JDD+ID=005047; while the RDN for Jane Deer may in fact be 
emplName=Jane Deer and the DN may be orgNarae=IBM, siteName=Arizona, 
emplNarae=Jane Deer. 

The nature of the LDAP data model means that hierarchies may be 
varied and complex; similarly the naming scheme for objects as 
exemplified above also permits substantial variability. As a result, the 
schema definition itself for a directory does not provide a mechanism 
that can be easily adapted for storage and access of the directory 
contents. Consequently a data retrieval system is needed whereby objects 
can be assigned to a store with indexing to permit subsequent efficient 
search and retrieval. 

Accordingly, the present invention provides a data retrieval system 
as claimed in claim 1 . 

Embodiments of the invention will now be described with reference 
to the accompanying drawings, in which: 

Figure 1 is a diagram illustrating a conventional ldap directory; 

Figure 2 is a conventional schema for the LDAP directory of Figure 

1; 

Figure 3 illustrates some hierarchical data; 

Figures 4(a) & 4(b) are conventional index and data tables for the 
hierarchical data of Figure 3; 

Figure 5(a) & 5(b) are index and data tables for use in a data 
retrieval system according to a first embodiment of the invention; and 

Figure 6(a) & 6(b) are index and data tables for use in a data 
retrieval system according to a second embodiment of the invention. 



The most frequently used search and retrieval operations in the 
LDAP protocol, and for most hierarchical databases, are: 

1. Retrieval of the object from the specification of its DN. Using the 
data of Figure 1, for example, retrieve the object orgName=Microsof t, 
prodNaine=Windows3 . 1 . 

2. Search of the directory tree, from a parent object specified by DN, 
where a value for an attribute is specified, so as to retrieve a subset 
of its immediate children. For example, again using Figure 1, search from 
orgName=lBM, si teName- Arizona for emplName= John . 

3. As above, but to retrieve an object and any descendant of the 
object rather than be restricted to immediate children. For example, 
retrieve orgName=lBM and all its descendent objects. This may be combined 
with further search criteria, for example, emplNarae=John Doe. 

The precise details of the mapping of directory objects into tables 
is not part of this disclosure. Although in practice the objects will be 
mapped into several tables, it is simpler here to assume that all the 
objects are assigned to a single table. It is necessary, however, that 
each object is assigned a unique identifier. Although it is permissible 
to use the DN for this purpose, the DN is generally long and of varying 
length and therefore somewhat unsuitable. Thus, in the present 
embodiments, a unique numeric identifier is assigned to each object. 

Taking the data of Figure 3 for example, a conventional storage 
scheme which might normally be adopted is shown in Figures 4(a) and 4(b). 
Two tables are involved; an index table, Figure 4(a) which maps between 
each object DN <A,B,M...Y) and unique identifier (1...7), and a data 
table which holds a row for each object. The data table also holds the 
unique identifer of the object's parent. The data table has columns for 
the various object attributes, including one for the unique object 
identifier, in summary: 

index table (row for each object) : 
Object name (DN) 
Object identifier 



Data table (row for each object) 

Object attributes (one column for each) 



Object identifier 
Parent object identifier 



variations on this general theme may be used e.g. the parent 
identifier may be stored in the index table rather than in the data 
table. However all similar schemes have the characteristics that they 
support direct retrieval of an object whose name is known, but do not 
provide for efficient search and/or retrieval for descendants explained 
in point 3 above. For example, if the objects for the database of Figure 
1 are not stored in order in tables of the type shown in Figure 4, then a 
search for the descendants of IBM, could only retrieve descendants of the 
Arizona object stored sequentially after the location of the Arizona 
object. The search engine would then need to traverse the table again to 
find all children of the Arizona object stored before the Arizona object 
in the table, and so on for these children. 

A retrieval system operating on such an index and data table must 
effectively navigate the hierarchy, thereby resulting in many sequential 
operations and traverses of the data table. If the tables are implemented 
in a relational database this prohibits the use of the relational 
operators to conduct a full descendants search in a single traverse of 
the table. 

The data retrieval system according to the invention overcomes 
these limitations. 

For each object, its position in the hierarchy can be described by 
the sequential concatenation of its own unique in the directory 
identifier with those of their parents, taken in sequence. This 
collection of values will be termed the position key. Note that in the 
LDAP case, the position key would generally not be the same as the DN, 
which is formed by the concatenation of unique at that branch of the tree 
identifiers . 

in a first embodiment of the invention, Figures 5(a) and 5(b), the 
position key (pkl, P*2, pk3) for an object is preferably stored as a set 
of values in a suitable number of columns assigned in the both the index 
and data tables (one column being required for each level in the 
directory tree hierarchy) . The advantage of the position key is that the 
object data is now very easily searched on a hierarchical basis; thus if 
any descendants of a particular object are required, the position key of 



the parent can be used in a search condition on an object table {see the 
example below) . Moreover the key can also be used to control the level of 
searching, if only the immediate descendants are required then the search 
above can be further restricted by requiring that all other columns 
assigned to the position, save that for the level of the immediate 
descendant, be null, variations on this allow control of the depth of the 
search. 

Using the tables of Figure 5 (a) and 5(b): 

1. A is found by a select on the data table where: identif ier«*l . 

2. The immediate children of A are found by a select on the data table 
where: pkl«l & pk2!»null & pk3=null. 

3. All descendants of A are found by a select on the data table where: 
pkl-1 s pk2I-null. 

4. The children of M are found by a select on the data table where: 
pkl*l & pk2=3 & pk31=null 

where i* designates the boolean operator "not equal". 

A second embodiment. Figures 6(a) & 6(b), overcomes the problem of 
the first embodiment taking significant storage in the index table. It 
will be seen that is not necessary to use all the columns of the position 
key to achieve the desired effect. Only the lowest column (i.e. that non- 
null column furthest from the root) is significant in identifying an 
object; the higher level columns contain redundant data. Moreover the 
value in this column is the unique object identifier itself. 
Accordingly, in the index table, Figure 6 (a) , instead of adding the 
position key to the contents previously described it is sufficient to add 
a single column, entitled Level, containing the level of that object in 
the hierarchy (this indicates the position key column relevant to the 
unique identifier) . 

In the data table, Figure 6(b), given the information content of 
the position key, the two columns previously described that respectively 
contain the unique object and parent identifiers are no longer needed. 



The tables are now; 



Index table (row for each object) : 



Object name 

Object identifier 

Object level in directory tree 



Data table (row for each object) 



Object attributes (one column for each) 

Position key identifier (one column for each level in the 



hierarchy) 

Using the tables of Figures 6(a) & 6(b): 



A 



is found by a select on the index table where: identif ier=l . 



2. The immediate children of A are found by a select on the data table 
where: pkl=l & pk2=!null & pk3=null . 

3. All descendants of A are found by a select on the data table where: 
pkl=l & pk2=!null. 

4. The children of M are found by a select on the data table where: 
pk2=3 & pk3=!null. 

Thus, in comparison with the conventional tables of Figure 4, the 
index table of the second embodiment contains one extra column, while the 
data table of the second embodiment contains extra columns for two less 
than the number of levels in the hierarchy. However search operations are 
now reduced to a simple traverse of a the data table, instead of the 
complex sequence of selects previously required. 
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1. A data retrieval system in which a plurality of objects having a 
multi- level hierarchical relationship are stored, each object having a 
respective parent and a set of children, said system including an index 
table comprising a respective name and associated identifier for each 
object, and a data table comprising a respective set of attributes and a 
position key associated with each object in the system, each position key 
coaiHrising a series of components, each component corresponding to a 
level of the hierarchy, a first component of said key storing the 
identifier of an associated object, and each successive component storing 
the identifier of the parent of the object stored in the previous 
component. 

2. A data retrieval system as claimed in claim 1 in which said index 
table includes an attribute storing the respective level of each object 
in the system. 

3. A data retrieval system as claimed in claim 1 in which said index 
table comprises a position key associated with each object in the system, 
and said data table includes a respective identifier associated with each 
object in the system and a respective identifier of the parent of each 
object in the system. 

25 4. A method of retrieving an object name for an object stored in the 

data retrieval system claimed in claim 1 or 2, comprising the steps of: 

a. specifying an identifier of the object; and 

b. retrieving from the index table the name for the object whose 
identifier matches said specified identifier. 

30 

5. A method of retrieving the immediate children of an object stored 
in the data retrieval system claimed in claim 2 comprising the steps of: 
a - specifying an identifier of the object; 

b. searching the index table to ascertain the hierarchical level of 
35 said object; 

c. selecting from the data table objects where the contents of the 
position key component for said level matches the identifier of the 
object; 

d. for said objects where the contents of the position key 

40 component for the hierarchical level below said level are not null 

and where the contents of the position key component for the next 
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hierarchical level below said level are null, retrieving the 
respective object identifiers. 

6. A method of retrieving all descendants of an object stored in a 
data retrieval system claimed in claim 2, comprising the steps of: 

a. specifying an identifier of the object; 

b. searching the index table to ascertain the hierarchical level of 
said object; 

c. selecting from the data table objects where the contents of the 
position key component for said level matches the identity of the 
object ; 

d. for said objects where the contents of the position key 
component for the level below said level are not null, retrieving 
the respective object identifiers. 

7. a method of retrieving an object name for an object stored in the 
data retrieval system claimed in claim 3, comprising the steps of: 

a. specifying an identifier of the object; and 

b. retrieving from the data table the name for the object whose 
identifier matches said identifier. 

8. A method of retrieving the immediate children of an object stored 
in the data retrieval system claimed in claim 3 comprising the steps o£ : 

a. specifying an identifier of the object; and 

b. for objects where the contents of the parent identifier match 
the identifier of the object, retrieving the respective object 
identifiers . 

9. A method of retrieving all descendants of an object stored in a 
data retrieval system claimed in claim 3, comprising the steps of: 

a. specifying an identifier of the object; 

b. ascertaining the level of the object according to when a first 
component of said position key matches the identifier of said 
object; 

c. selecting from the data table objects where the contents of the 
position key component for said level matches the identity of the 
object; and 

d. for said objects where the contents of the position key 
component for the level below said level are not null, retrieving 
the respective object identifiers. 
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10* A method as claimed in claims 
carried out in a single traverse of 

11. A method as claimed in claims 
object identifiers are stored in the 
position keys. 



5, 6 or 9 where steps c) and d) are 
said data table, 

5, 6, 8, 9 or 10 where the retrieved 
first component of respective 
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